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ABSTRACT 



Reported is a study designed (1) to investigate the 
relationship between teacher-assigned chemistry grades and the scores 
obtained on a multiple-choice chemistry test built on taxonomic 
principles, and (2) to compare the contributions of various predictor 
variables to the explainable variance of the grades and the total 
test scores. The sample consisted of 2339 grade twelve chemistry 
students enrolled in the General Course in Ontario High Schools. Part 
one of the study was accomplished by computing Pearson product-moment 
correlation coefficients between subject scores on the Ontario Test 
of Achievement in Chemistry (OTAC) , an investigation constructed 
test, and teacher-assigned grades as well as students* scores on the 
Scholastic Aptitude Test, Ontario edition (SATO) 1963-64. The results 
indicate that teacher-assigned grades are not highly related to the 
DTAC score. To carry out part two of the study, the University of 
Michigan Automatic Interaction Detector computer program was used to 
identify variables contributing to the explainable variance of the 
two sets of achievement scores. This program also isolated groups of 
students in which different combinations of the predictor variables 
functioned most effectively. (LC) 
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This present study was designed (a) to investigate the 
relationship between teacher-assigned chemistry grades and the 
scores obtained on a multiple-choice chemistry test built on 
taxonomic principles , and (b) to compare the contributions of 
various predictor variables to the explainable variance of the 
grades and the total test scores. 

The cognitive objectives studied were restricted to 
Knowledge, Comprehension , Application , and Analysis as defined by 
the Taxonomy of Educational Objectives: Cognitive Domain . ^ The 

Ontario Test of Achievement in Chemistry (OTAC) , a 60-item end- 
of-course test designed to measure these cognitive objectives, 
was constructed and developed over a three-year period. Each 
cognitive objective was represented by a subtest; approximately 
40% of the items were devoted to testing Category 1.00 (Knowledge) , 
with the remaining items split almost equally among Categories 
2.00, 3.00 and 4.00 of the Taxonomy . The test was administered in 
mid-May of 1964.. 

The sample consisted of 2339 Grade 12 Chemistry students 
enrolled in the General Course (a college-preparatory course) in 
Ontario high schools. Of 50 schools selected at random, 30 
schools agreed to participate in the study, thus making available 
48 teachers and 80 classes of chemistry students. 

Students' scores on the Scholastic Aptitude Test, Ontario 
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edition (SATO) 1963-64 were retrieved from existing files. 

Students responded to the Inventory of Choices, a measure of 

2,3 

attitudinal orientation devised by Edwards and Wilson. 

Other information collected included final grades (marks) in 
chemistry, sex of student, immediate and future educational plans, 
occupational aspiration of the tudent, occupation of father and 
mo ther, language spoken in the home, type of school, and some 
characteristics of the home environment, the school environment, 
and the teacher. 

Pearson product-moment correlation coefficients were com- 
puted to carry out part (a) of the study. To carry out part (b) 
of the study, the University of Michigan Automatic Interaction 
Detector (AID) computer program 4 was used to identify variables 
contributing to the explainable variance of the two sets of 
achievement scores. This program also isolated groups of students 
in which different combinations of these predictors functioned 
most effectively.- 

The results of part (a) of the study are presented in 

Table 1. 
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TABLE 1 



CORRELATIONS BETWEEN FINAL CHEMISTRY MARK 
AND OTAC SCORES 



Score or Grade 


No. of 
Items 


Final 

Chemistry 

Grade 


SATO 

Total 

Verbal 


SATO 

Mathematics 


Category 1.00, 

Knowledge 


23 


.48 


.44 


.43 


Category 2.00, 

Comprehension 


11 


.44 


.43 


.53 


Category 3.00, 
Application 


14 


.49 


.45 


• .56 


Category 4.00, 

Analysis 


12 


.32 


.32 


.29 


OTAC Total 


60 


.56 


.53 


.58 


Final Chemistry 
Grade 


- 


- 


.32 


.37 



Examination of Table 1 shows that teacher— assigned grades 
are not highly related to either the total OTAC score or the 
Taxonomy subtests* It appears that OTAC and teachers of chemistry 
are to a large extent not measuring the same accomplishments. The 
correlation of Category 4.00 to Final Chemistry Grade is consider- 
ably lower than the corresponding correlation of other Taxonomy 
subtest scores. 

Inspection of Table 1 also shows that teacher— assigned 
grades are not as highly related to scholastic aptitude as are most 
OTAC scores , with the exception of Category 4.00 scores. The 
correlation of final chemistry grades to SATO Mathematics is higher 
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than the correlation to SATO Total Verbal ; a similar relationship 
is observed for GTAC Total scores. Category 2.00 scores and 
Category 3.00 scores. The reverse relationship is observed with 
Category 4.00 scores and SATO scores. 

For the Taxonomy subtests the correlations with final 
chemistry grades are approximately the same as with SATO Total 
Verbal scores, with slightly less agreement being observed for the 
correlations between Taxonomy subtests and SATO Mathematics scores. 

Tables 2 to 6 and Figures 1 and 2 present the results of 
part (o) of the study. 
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TABLE 2 



ABBREVIATIONS FOP. INDEPENDENT VARIABLES 
USED IN AJD ANALYSIS 



Abbreviation 



Variable 



SATO TV 
SATO MATH 
P-T 4 
P-I 4 
P-A 4 
T-I 4 
T-A 4 
A- 1 4 
SEX 
OCCF 
OCCM 
OCCS 

REPEATING 
ATTITUDE 
LANGUAGE 
ED PLANS 1 
ED PLANS 2 
SCHOOL TYPE 
TEXT 



Scholastic Aptitude Test (Ontario)—* Total Verbal Score 

Scholastic Aptitude Test (Ontario) — Mathematics Score 

Inventory of Choices , Prudent-Theoretic 4-point scale 

Inventory of Choices , Prudent- Immediate 4-point scale 

Inventory of Choices, Prudent-Aesthetic 4-point scale 

Inventory of Choices, Theoretic- Immediate 4-point scale 

Inventory of Choices, Theoretic-Aesthetic 4-point scale 

Inventory of Choices, Aesthetic-Immediate 4-point scale 

Sex of student 

Occupation of father 

Occupation of mother 

Occupational aspiration of student 

Repeating Grade 12 Chemistry 

Attitude toward school 6-point scale 

Language spoken in the home 

Immediate educational plans 

Future educational plans 

Publicly supported, Roman Catholic, Independent private 
Textbook used in chemistry class 
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TABLE 3 



Variable 
ED PLANS 1 



P-T 4 
T-I 4 
REPEATING 



INTERPRETATION OF CATEGORICAL VARIABLES 
APPEARING IN AID TREES 



Code Interpretation 

0 not indicated 

1 complete Grade 12 only 

2 complete Grade 13 

3 leave before completing Grade 12 

4 undecided 



0 highly theoretic orientation 

1 moderately theoretic orientation 

2 moderately prudent orientation 

3 highly prudent orientation 

0 highly immediate orientation 

1 moderately immediate orientation 

2 moderately theoretic orientation 

3 highly theoretic orientation 



0 not indicated 

1 not repeating Grade 12 Chemistry 

2 repeating Grade 12 Chemistry 



CL 

3 

o 

fc_ 

a) 

c 



Tl 

<D 

c 

rt) 

+- 

C 

O 

u 



-D 

+- *L- 

— (D 

— > 

CL 

10 O) 

c 

ov- 
c +- 
+- 

10 — Q- 
3—3 

id a o 



r- 1 

3 


ro / 


0 vD 


iH 


H ^ 


• 


1 


in 


(J O 


04 l 


§ 







rH 






(/> 


>1 




2 


r -4 


04 


2 


c 


• 




0 


04 


CL 


04 


04 


O 






w 







X 






a 


O' 


04 


s 


rH 


• 




1 


tjt 


o 


\D 


04 


H 


r-i 


< 






0 ) 








n> • 
(T3 O 
+- Z 



C 

0 ) 

u 

L. 

0 ) 



CL 

3 

o 

1 _ 




CL O 



- 7 - 




PIQ # 1 - AID Tree for OTAC Total Scores 



cn cn 



o o 01 ** 



q pH pH pH O ^ 



fM O ™ O 



O 

Z 



a 

a 



CM 

o 



0) 

O' 

Id 

«p 

c/> 

X 

o 

id 

w 

«P 

id 

V< 

5 

O 

•w 

a t? 
0) 

8 ‘ 

•g 

m 
M 



(0 



o: »4 o 

o 2 i? 

Cm 



(/) 



U 

O 

$ 5^ ** 
5 w 



o 

3 



u 

a) 



§• 

o 

H 

o 



id 

o 4 

cn 

o 



w 

§• 

o 

M 

V 

c 

<u 

0) 

B 



Jh 

<N 

b 



« 



IK 

(N 



b 

CN 

& 

pH 

fc 

CN 

vO 

5> 

pH 

O' 

GO 

cn 



<N O pH O 



o «-H O »"H O 



.Q 

id 

•H 

M 



■) 


CN 


1 

0 


O 


O 


CN 


pH 


cn 


CN 


CN 


pH 


* 


O 


0 

1 


O 


pH 


O 


pH 


O 


pH 


pH 


O 


3 


pH 


1 

0 


CN 


pH 


O 


pH 


O 


pH 


O 


cn 


H 


■H 


cn 


cn cn 


O 


pH 


pH 


CN 


cn 


pH 


pH 


cn 


CN 


m 


cn CN 


pH 


fO 


pH 


O 


cn 


pH 


CN 


CN 


CN 


cn 


Id pH 


CN 


CN 


m 


O 


pH 


pH 


pH 


m 


cn 


cn 


3 

0 


pH 


fO 


pH 


O 


cn 


pH 


CN 


CN 






CN pH 


O 


CN 


CN 


pH 


cn 


pH 


CN 


CN 




v m 


df CN 


pH 




CN 


O 


np 


pH 


pH 


cn 




in 


• m 


0 

0 


O 


fO 


pH 


pH 


pH 


O 


pH 


cn 



pH m pH «H pH O ° 

pH O O O ** H ° 



pH O 



O o 



<N (N pH cn CN O 

pH O O <*> H O 



CN 

cn 



© 

© 



m pH 
pH O 



H *H 00 (M O 



^(NrHO^^OCNrOOCN l-lO 



(>j (\ rl H ^(g)S ^ H H 10 " " " " ” 



vo (&) 



pH CN O O O O ™ 



Ifi O O o 



c , W „ 0 OS 2 «-»OO 0 > 0 . -MO^O 

ft VV ^ N 



Ifl | H [HV ° O ft N *-< ° ^ 

*H V^V ft 



CN 



in rH O VO O O 



ro |f®\ O n 
. voj vn ft 



" “ R) R ® 



s a 



X 

H 




0 


cn 


m 


CN 


O 


O' 


O 


pH 


d* 


ut 


O 


w 1 




pH 


f< 


CN 


21 


15 


10 


V0 


pH 


pH 


12 


in 


d 1 

1 


CN 


27 




CN 




\0 




CN 


GO 


I 


m 


v0 


CN 


d* 


pH 


47 


0 


d* 


pH 


CN 


10 


pH 


GO 


m 


V0 


m 

m 


pH 




O 




5T 


pH 


pH 


d* 


cn 


pH 


V0 












pH 





& 3 

2 8 
* * 



CN M 



d* 


d* 


d» 


d* 


5j* 


d* 


H 


M 


< 


M 


< 


M 


d 


O 4 




H 


H 


< 


d* 


m 


vO 




GO 


O' 



X 

w 

cn 



PN cn ro 

pH H H 









pH 


0 






0) 


z 


U 


u 


M 


Q 


0 


■ Z 


H 


D 


4 ; 




S 


H 


D 


04 


u 


M 


O 


04 


H 


Z 




H 


< 


Q 


2 


< 


a 


U 


d 1 


m 


10 




pH 


pH 


pH 


pH 



U 

a* 

>« 

H 

§ s 

u w 

W P 



(0 ov 



•9 



<D 

pH 

•a 

•H 

<d 

> 

O' 

c 

Q) *H 

pH <P 
«P 

-H 

•H pH 
V 4 04 

id w 

> * 

w m 

•H 0 ) 

«; 
c x 
O 0 ) 

c 

•8 o 

a * 
(0 
<P 

•HI C 
pH *H 
04 0 
cn CU 

O’ 



& 

o 

O 



id 

c 

•H 

Cm 



§* 

0 

V 4 

o 



id 

c 

•H 

Cm 



TJ 

c •o 

•H 0 

id c 

pH 'H 

&3 

S & 

a u 



- 8 - 




CL 

3 

o 

L_ 

o> 

c 



-o 

© 

c 



10 

4* 

c 

O 

U 

© 

J3 

<0 



4- i- 
— <0 
— > 

CL 

*1 m 

i: 

m— 

i i* 

— *- 
m •* • i\ 
» - - i 
in it <i 




© 

O 

© 

c 

© 

© 



© 

<L 



O 

z 

CL 

3 

o 

L. 

o 




- 9 - 



O 

ERIC 



PIG. 2 *■ AID Tree for Chemistry Marks 
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TABLE 6 



CONTRIBUTION OF IMPORTANT VARIABLES TO OTAC TOTAL SCORE 
VARIANCE AND FINAL CHEMISTRY MARK VARIANCE 



-ff-r s. 



Variable 


Percent of Variance 


Explained 


for OTAC Total Score 


for Final Chemistry 
Mark 


SATO Math 


27.55 


11.62 


SATO TV 


10.66 


1.97 


Ed Plans 1 


1.50 


6.52 


T-I 4 


1.02 


0.50 


P-T 4 


0.54 


- 


Repeating 


- 


0.90 


Total 


41.27 


21.51 
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The Automatic Interaction Detector program permits compari- 
sons of the components of variance of OTAC scores and final chemistry 
grades that are not evident in correlation studies. Both AID runs 
used the same set of explanatory variables. Comparison of the two 
"^ID trees" (Figures 1 and 2, Tables 3 ( 4, 5, and 6) yields the 
following observations: 

.$ATO Mathematics is the best splitting variable for both 
OTAC scores and final chemistry marks; both splits are very much 

alike. 

SATO Total Verbal is the next best splitter, for both OTAC 
scores and final chemistry marks, for those students obtaining an 

above-average score in SATO Mathematics . 

For students who do not obtain an above-average score in 
SATO Mathematics, SATO Total Verbal , th* next best splitcer for 
OTAC scores, is not as effective as irrr.Iiate educational plans in 
splitting groups when final chemistry *arks is the dependent 
variable. In other branches and of the final chemistry mark 

AID tree, Mediate educational plans supplants SATO Total Verbal 

as a predictor. 

The Theoretic- Immediate variable operates more effectively 
in a different verbal aptitude range in explaining final chemistry 

marks theui it does in explaining CTAC scores. 

The Prudent-Theoretic variable does not effectively split 

i 
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any final chemistry marks group, although the variable is useful in 
explaining the variance of OTAC scores. 

The variable Repeating, which did not function effectively 
in explaining OTAC Total scores, is a good predictor of final 
chemistry marks for students of moderate to low mathematical abil- 
ity who do not plan to enter university. 

The percentages of variance explained by the effective 
splitters for the two dependent variables are compared in Table 6. 

It is seen that those independent variables that are useful 
as predictors for both dependent variables operate to explain the 
variance of the dependent variables in quite different ways. The 
ratio of SATO Mathematics to SATO Total Verbal in terms of variance 
explained is especially striking. Also of note is the effective- 
ness of immediate educational plans compared to SATO Total Verbal 

as a predictor of final chemistry marks. 

The findings also suggest that the same accomplishments 
are not being measured by grades and OTAC scores, and that compara- 
tively little emphasis has been placed, either in teaching or 
examining, on the achievement of abilities that are subsumed under 
the cognitive objective Analysis . 
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